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PCT/US98/14194 



A METHOD AND APPARATUS FOR SEGEHENTATION, REASSEMBLY 
AND INVERSE MULTIPLEXING OF PACKETS AND ATM 
CELLS OVER SATELLITE /WIRELESS NETWORKS 

The present application is based on U.S. provisional 
application S,N. 60/052,359 filed on July 15, 1997 and 
priority therefront is claimed under 35 U.S.C. §120, The 
entire content of Provisional implication S.N. 60/052,359 
5 is incorporated herein by reference. 

FIELD OF THE INVPNTION 
The present invention relates to the efficient and 
reliable transmission of packet or cell-based information, 
such as frame relay, SS7, ISDN or asynchronous transfer 

10 mode (ATM) based information, via wireless links. More 
specifically, the present invention relates to a method 
and apparatus for segmentation, reassembly and inverse 
multiplexing of packets and ATM cells over satellite and 
wireless links in a way that minimizes the requisite 

15 overhead contained in packet, cell and frame headers. 

BACKGRQUMP QF THE INVEMTIQN 
There are a variety of methods for transmitting 
information via a broadband Integrated Services Digital 
Network (B-ISDN) , using a variety of protocols related to 
20 Asynchronous Transport Mode (ATM) , frame relay mode, ISDN 
and SS#7 modes of treinsmission. The ATM mode, as the 
exemplary preferred embodiment, was originally 
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investigated by a group called the International Telephone 
and Telegraph Consultative Committee (CCITT) . The group, 
currently called the International Telecommunication Union 
Telecommunications Standards Sector (ITU-TSS) , 
5 investigated a new form of ISDN that would have the 
flexibility to accommodate a large number of channels and 
the ability to transfer large amounts of data at a very 
fast rate. At the end of the study, the committee decided 
to adopt ATM as the target transfer mode for the B-ISDN. 
10 The ITU-TSS is currently defining the wide area network 
(WAN) standards for ATM. 

ATM is a transfer mode that sends 53 octet-sized 
packets of information across a network from one 
communication device to another. The 53 octets are 

15 assembled as a ^^cell" , which comprises 48 octets of data 
information, referred to as the "payload", and 5 octets of 
"header" information (including the routing information) . 
The header and data information must be organized into 
cells so that when the cells are filled, they can be sent 

20 when an open slot of 53 octets becomes available. 

There are two forms of headers that are specified in 
the CCITT Recommendation 1.361. Each form is 5 octets 
long. There also are two different ATM network 
connections, each one having a different type of header. 
25 One connection form is the user-network interface (UNI) , 
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which is used between the user installation and the first 
ATM exchange and also within the user's own network. The 
other form of connection is the network-node interface 
(NNI) which is used between the ATM exchanges in the trunk 
network. The header format for the UNI consists of the 
following fields: 

Generic flow control (GFC) field of 4 bits. 
It can provide flow control information towards 
the network from an ATM endpoint . 

Routing field of 24 bits. Eight of the bits 
are VPI (virtual path identifiers) and 16 bits 
are VCI (virtual channel identifier) . Eirpty 
cells with both the VCI and VPI set to zero 
indicates that the cell is unassigned. 

Payload type (FT) field of 3 bits. This 
field is used to provide information on whether 
the cell payload contains user information or 
network information. This field is used by the 
network to intercept ciny important network 
information. 

Cell loss priority (CLP) field containing 1 
bit- This field may be set by the user or 
service provider to indicate lower priority 
cells. If the bit is set to 1 the cell is at a 
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u risk of being discarded by the network during 

busy times. 

Header error control (HEC) field of 8 bits. 
This field is processed by the physical layer to 
5 detect errors in the header. The code used for 

this field is capable of either single-bit 
error-correction or multiple -bit error- 
detection. 

As seen in Figures lA and IB, the header format for 
10 the NNI is the same as the header information of the UNI 
except that there is no GFC, and the VPI of the routing 
field is 12 bits instead of 8 bits. 

Error detection occurs only within the header 
message. No error detection of the data occurs within the 

15 information portion of the cell. The receiving endpoint 
determines whether the data can be corrected or whether it 
must be discarded. When a link or node becomes busy, an 
ATM network must discard cells until the problem is 
resolved. The first cells to be discarded are the cells 

20 that have a CLP bit in the header set to a "1" . Since 
connection endpoints are not notified when a cell is 
discarded, higher layers of protocols are needed to detect 
and recover from errors. 

A cell is sent along a channel called a Virtual 
25 Channel Connection (VCC) . A VCC consists of a series of 
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links that establish a unidirectional connection through 
the network that allows the flow of information from one 
endpoint to another endpoint. Cells on a VCC always 
follow the same path through the network. Therefore, each 
5 cell arrives at its destination in the same order in which 
it was transmitted. VCCs can be unidirectional or may 
occur in pairs, thus making the connection bi-directional, 
VCCs can be within a Virtual Path Connection (VPC) , 
meaning a group of virtual channels that are associated 

10 together, so as to be sent as a large trunk for a part of 
network. The VCCs are multiplexed and demultiplexed at 
appropriate network nodes in the network. Each VCC and VPC 
have specially assigned numbers called Virtual Channel 
Identifiers (VCI) and Virtual Path Identifiers (VPI) , 

15 respectively. These numbers help the system determine the 
direction in which the cells belonging to the connection 
should be sent and which applications should be associated 
with the connection. 

Although ATM-based transmission, switching, and 
20 network technology has been employed in broadband 
integrated services digital networks (B-ISDN) which rely 
on fiber optics, there are numerous difficulties 
associated with implementing ATM based technology in a 
wireless communication network. These difficulties 

25 include the fact that ATM-based networks and switches rely 
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on a nurnber of high speed interfaces. These high-speed 
standard interfaces include OC-3 (155 Mbit/s) , OC-12 (622 
Mbit/s) and DS3 (45 Mbit/s) . However, a few ATM based 
networks and switches support lower speed interfaces, such 
5 as Tl (1.544 Mbit/s) and the programmable rate RS-449 
interface . 

As a consequence, there are only a few interfaces 
which can support the comparatively low transmission rates 
(less than 1 Mbit/s to a 8 Mbit/s) used in wireless 

10 commxinication. Although commercial satellite and wireless 
modems support these low transmission rates using an RS- 
449 programmable rate interface, it is difficult to 
implement ATM based technology in a wireless environment 
using conventional interfaces, such as the satellite 

15 environment seen in Figure 2, because most ATM traffic is 
transmitted over high rate data interfaces. Figure 2 
illustrates the interconnection by a satellite relay 
between multiple terminals (Terminal 1 and Terminal 2, 
merely by way of example) , using a time division multiple 

20 access (TDMA) network wherein bursts of information are 
sent to the satellite in a time divided manner for 
assembly and distribution to the terminals in a frame 
format . 

Another difficulty associated with implementing ATM 
25 based technology in a wireless communication network has 
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to do with the fact that ATM based protocols rely on 
extremely low bit error ratios which are typical of fiber 
optics based networks. By way of example, ATM protocols 
assume that the transmission medium has very low Bit 
Error Ratios (BER) (10'") and that bit errors occur 
randomly . 

In contrast, the bit error ratios associated with 
wireless commxinication are much higher (on the order of 
10"^ to 10"®) and tend to fluctuate in accordance with 
atmospheric conditions. In addition, the errors 

associated with wireless communication tend to occur in 
longer bursts. Thus, a robust error correction scheme 
must be employed in a wireless network in which ATM based 
technology is to be implemented . 

In addition to the difficulties discussed above, 
there is another significant constraint placed on 
wireless communication networks which is not imposed on 
terrestrial based fiber optics networks. This constraint 
has to do with the fact that the cost of bandwidth in a 
wireless network is much higher than for fiber optics 
networks. As a consequence of having been traditionally 
implemented in fiber optics networks, ATM based 
technology is not particularly efficient in its use of 
transmission bandwidth. Therefore, if ATM-based 



wo 99/04521 g PCT/OS98/14194 

technology is to be implemented in wireless networks, it 
must achieve a more efficient use of bandwidth. 

Networking protocols have evolved over the years. 
Protocols have evolved from supporting the low rate X.25 
kind of services to carrying high rate ATM traffic. 
Therefore, today's networks are required to support 
several different protocols like X.25, TCP/IP, Frame 
Relay, ISDN, SS7, etc. Protocols such as Frame Relay, IP 
and X.25 have varicible size traffic. ATM on the other 
hand has fixed size cells. Therefore a network supporting 
multiple protocols must be capable of transporting 
variable size data. 

Transmission links themselves limit the maximum 
packet size that can be transmitted over the link. This 
requires a variable length packet to be split into 
smaller segments before transmission and be put together 
at the destination before delivering to the user. The 
process of splitting the packet is called segmentation. 
The process of reconstructing the original packet is 
called reassembly. 

Often nodes in a network are interconnected using 
multiple transmission links. This is done sometimes to 
get additional bandwidth, sometimes because the network 
topology demands it, or for redundancy. When packets are 
transmitted over these links, they may appear out of 
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order at the destination node. Users expect that packets 
be delivered back to them in the order in which they were 
sent to the network. Therefore, packets need to be 
resequenced before they are delivered to the user. This 
process is also commonly referred to as **inverse 
multiplexing" . The terms ^^resequencing" and '^'inverse 
multiplexing" are used interchangeably herein. 

Networks have also evolved in complexity. Older 
networks traditionally used static bandwidth management 
schemes . Today' s networks do "bandwidth- on- demand" , i . e - 
bandwidth is continuously changing while the. network is 
carrying traffic. Therefore, the solutions developed 
should work in a bandwidth-on-demand environment. 

The problems of segmentation, reassembly and 
resequencing have been addressed before. However, 
existing solutions do not meet the needs of a bandwidth- 
on-demand satellite network. Some of the current 
approaches have relatively large segment headers. 
Bandwidth is a precious resource in a satellite network. 
If these solutions were to be applied to a satellite 
network, they would waste a lot of bandwidth. This is 
especially important if the network must carry ATM 
traffic, since the payload size per cell is fairly small 
(ATM cells have a 5 byte header and 48 bytes of data) . 
Also, the current algorithms, like the IP reassembly 
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algorithm, are more complicated and have a higher 
processing power requirement. This makes it harder to 
implement the algorithm in software for intermediate data 
rates (e.g. 8 Mbits/ sec) . Special hardware is required, 
which raises the cost of the product. 

In bandwidth-on-demand networks, the bandwidth to 
different destinations from each node is continuously 
changing. The above algorithms for segmentation, 
reassembly and resequencing must be capable of adapting 
to the varying bandwidth. 

Some cell- or packet -based protocols, such as Frame 
Relay and ATM, are connection oriented while others, like 
IP are datagram oriented. Any solutions developed should 
be able to work with both connection- and datagram- 
oriented protocols. This also makes it easier to handle 
network management traffic. 

Low rate modems are sin5)ler and cheaper to build. 
They also impose less stringent power requirements on the 
system. Therefore, it is desirable that each terminal be 
equipped with a low rate modem, that terminals be stacked 
up , and that every terminal in the stack be allowed to 
use spare capacity on other terminals. This is a simpler 
and less expensive system model as opposed to a single 
high rate modem. Segments may then have to travel through 
intermediate terminals on the path from the source to the 
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destination. The algorithms should be capable of 
supporting this model. 

Two algorithms that have been used for segmentation 
and reassembly in the past are the IP and the ATM 7VAL-5 
5 algorithms. However, each of these algorithms has 
deficiencies that are overcome by the present invention. 

The IP segmentation algorithm inserts a packet 
number and the byte offset of the segment relative to the 
start of the packet in every segment. The use of a byte 

10 offset is required because IP has to deal with different 
protocol data unit (PDU) sizes across different 
transmission links in the network. IP packet headers are 
fairly large, which results in a substantial amount of 
wasted bandwidth. Also, the IP reassembly algorithm has 

15 to keep a list of previously received segments of each 
packet, typically in a predetermined location. Therefore, 
on receiving a new segment, a search must be performed in 
order to find the proper location of the new segment in 
the list. 

20 The ATM AAL-5 algorithm works on a per- virtual 

circuit (VC) basis. Therefore, it cannot handle datagram 
traffic without first creating special VCs to carry such 
traffic. 

Traditionally inverse multiplexing has been circuit- 
25 based, used primarily to get more bandwidth between two 
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nodes using multiple fixed rate trunks and to compensate 
for variable delays encountered in the network. The 
traditional model for inverse multiplexing is shown in 
Figure 3. In this model the source network nodes 10 and 
the destination network nodes 20 are connected to a 
network 50 via special hardware units called an inverse 
multiplexer 30. Each node, in fact, will have both 
source and destination components, as shown. The inverse 
multiplexers 30 are also interconnected using multiple 
low or intermediate rate trxinks 40. The assembly provides 
a high rate pipe between the two network nodes. 

In the case of a bandwidth-on-demand satellite 
network, the transmission capacity to different 
destinations increases and reduces dynamically. However, 
the traditional inverse multiplexing model does not 
permit dynamic changes in bandwidth or, in particular, 
the use of spare capacity on other co-located terminals 
for sending segments through them. 

More recently, packet-based inverse multiplexing 
schemes, such as the one used by the Multilink Point- to- 
Point (MLPTP) have been proposed. However, in that 
method, each segment needs a sequence number, a 
requirement that increases header size and reduces 
efficiency. 



wo 99/04521 j2 PCT/US98/14194 

Accordingly, it is an object of the present 
invention to provide a method and apparatus for the 
segmentation, reassembly and inverse multiplexing of 
packets and cells over satellite/wireless links. 

It is a further object of the present invention to 
provide a low transmission rate interface comprising a 
method and apparatus for the segmentation, reassembly and 
inverse multiplexing of packets and cells. 

It is yet another object of the present invention to 
provide an interface that supports a plurality of cell- 
and packet -based protocols with both fixed and variable 
sized traffic. 

It is another object of the present invention to 
provide a low transmission rate interface comprising a 
method and apparatus for the segmentation, reassembly and 
inverse multiplexing of packets and cells using protocols 
that are either datagram or connection oriented. 

SUMMARY OF THE INVENTION 
The present invention overcomes the above-mentioned 
problems associated with implementing cell- or packet - 
based technology in a satellite/wireless communication 
network and achieves the stated objects by providing a 
unique frame format for a communication signal containing 
a bit stream having cell- or packet -based formatted data. 
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The present invention comprises a method and 
apparatus for providing segmentation^ reassembly and 
inverse multiplexing in bandwidth-on-demand satellite/ 
wireless networks. 

5 The present invention further comprises a 

segmentation process and apparatus for inserting a 
sequence number, source and destination node information 
in every segment of a packet. The inserted information is 
used to identify all segments of the same packet on 
10 reception and to reconstruct the original packet. 

The present invention further comprises a 
segmentation process and apparatus in which source and 
destination node infoarmation is derived implicitly, so it 
doesn't have to be transmitted over the link. More 

15 particularly, the present invention further comprises an 
inverse multiplexing process and apparatus based on an 
algorithm that works within a frame, using an implicit 
preference order of transmission of segments in bursts. 
Such order is known to both the sender and the receiver, 

20 so the receiver can sort segments to restore their 
original order. 

In the method and apparatus of the present 
invention, the protocol data units (PDUs) transmitted 
over a satellite link have a fixed size. 
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In the method and apparatus of the present 
invention, segments that are formed and transmitted out 
of sequence are resequenced before reassembly. Further, 
a siabsequent segment in a sequence is always appended to 
a packet as it is thus far assembled, thereby making the 
assembly algorithm simple with fewer lines of code. 
Moreover, the assembly algorithm used in the method and 
apparatus of the present invention does not use a 
sequence number for the resequencing operation. 

The algorithms used in the method and apparatus of 
the present invention are adapted to provide the 
following advantages over existing algorithms: 

1. Since the algorithms require smaller transmission 
headers for each segment, a significeuit savings in 
bandwidth is achieved. 

2. Since inverse multiplexing is performed prior to 
packet and cell reassembly, the reassembly algorithm 
can be simplified, since the algorithm can predict 
for each packet or cell the precise segment to 
expect next. 

3 . The inverse -multiplexing algorithm is simpler 
than conventional algorithms, such as ATM AAL-5 and 
IP algorithms, and the time taken for cell or packet 
transmission is directly proportional to the rate of 
data transfer between the two nodes. 
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4. Since the algorithms are both cell- and packet - 
based, they are suitable for use in bandwidth- on- 
demand networks. 

5- The algorithms are designed for a network in 
which terminals at a site can be stacked together. 
The terminals at the same site communicate using a 
local area network (LAN) . Any terminal at a site can 
use spare capacity at any other terminal at the same 
site. 

BRIEF DESCRIPTION OF THE PRftWINGS 
These and other features, aspects and advantages of 
the present invention will become better understood with 
reference to the following description, appended claims, 
and accompanying drawings, in which: 

FIGs • lA and IB show an ATM cell structure having the 
UNI and NNI header formats, respectively. 

FIG. 2 shows a conventional wireless/satellite system 
arrangement . 

FIG. 3 shows a Traditional Model for Inverse 
Mul t ipl exing . 

FIGs. 4A and 4B show schematic diagrams of a network 
reference model and an interface design that is relevant 
to the present invention. 
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FIG. 5 illustrates the TDMA frame structure with 
three bursts Bl, B2 and B3. 

FIG. 6 illustrates examples of a terminal ID format 
in accordance with the present invention. 

5 FIGS.7A and 7B illustrates examples of segmentation 

in accordance with the present invention. 

FIG. 8A illustrates a segmentation and reassembly 
(SAR) protocol data unit (PDU) for an ATM application, in 
accordance with the present invent ion . 

10 Fig. 8B illustrates the content of a frame carrying 

packets or cells within SAR segments in a burst. 

Fig. 8C illustrates the interconnection of units 

within two terminals that provides a variable bandwidth on 
demand. 

15 Figs. 9A-9C illustrate Transmission PDU formats. 

Fig. 10 shows a 16 bit key, relevant to the present 
invention. 

Fig. IIA is a flowchart illustrating the generation 
of SARI and SAR2 headers, with Fig. IIB illustrating the 
20 transmission of segments with SARI and SAR2 headers. 

Fig. 12A is a flowchart illustrating the resequencing 
process, with Fig. 12B illustrating the reassembly process 
and Fig. 12C illustrating the process on receiving a 
variable length packet from the resequencer. 
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Fig. 13A is a high level description of a frame 
relay system, with Fig. 13B illustrating the various 
fields in a Spacket and Fig, 13C illustrating a Spacket 
frame . 

5 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The subject matter of the present invention is 

generally applicable to cell and/or packet -based 

information formats for use in time division transmission 

systems, such as TDMA and TDM. For purposes of a 

10 preferred embodiment, the invention may be best 
illustrated with respect to its application to 
communications within an ATM-based or frame relay network 
that includes links via wireless or satellite using TDMA 
transmissions. In a first preferred embodiment, the 

15 invention is based on an interface that uniquely 
identifies ATM cells or packets for transmission of ATM- 
based traffic in a wireless communication network using 
TDMA. The interface may also facilitate the transmission 
of ATM-based traffic over a TDM-based network. Application 

20 of the invention to other cell- or packet -based 
information formats will be readily apparent to one of 
ordinary skill in the art. 

The present invention specifically concerns a novel 
scheme, incorporated in the interface of a terminal that 

25 connects to a wireless terrestrial or satellite system 
that uses the point to multi-point capabilities of TDMA or 
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TDM techniques for multiple access by 

transmitting/receiving stations to a shared communication 
medium. 

FIG. 4A is a schematic illustration of a 
5 communication system 100 involving a network control 
center (NCC) 140 and plurality of terminals {T0-T5) that 
are arranged into physically distributed sites (two in the 
illustration: SI, 32) , Each site SI, 82 has respective 
terminals {T0-T2; T3-T5) connected by a respective local 

10 area network (LAN) 110 and 120. The sites SI, S2 are 
themselves connected by a terrestrial wireless or 
satellite link 130 that can operate in any range of 
frequencies, e.g., the range of 2.4 Kb/s to 8.448Mb/s for 
a satellite 160, and provide point to multi-point 

15 communication. Each terminal (T0-T5) has a built-in 
modem (as siabsequently defined) and ATM/TDMA interface 
(not shown) , the interface being used to transmit data to 
and from the satellite/wireless link 130 via antennas 115, 
125, as shown in Fig. 4A. The ATM/TDMA interfaces are 

20 operative to provide high quality service for ATM-based 
applications and to provide an efficient use of 
transmission link bandwidth. In a typical application, the 
ATM/packet switches 105, 150 are connected to respective 
groups of computers directly or through LAN routers, for 

25 example. The interfaces have TDMA equipment, including 
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modems, to connect together several terrestrial networks, 
using individual terminals, via satellite/wireless links 
130 in a point to multi-point or mesh network. 

The illustration in Fig. 4A is merely for 
5 explanation and, although only two sites SI, S2 are 
shown, where there is a larger number of sites, the sites 
may be organized into groups to which data can be 
simultaneously broadcast, such group being called a 
^'control group". Further, while a network control center 
10 140 is shown in Fig. 4A, as will be evident from the 
subsequent explanation of the invention, the terminals 
T(I) can operate in a distributed control environment as 
well . 

The ATM/TDMA interface 200 is illustrated in 
15 schematic form in Fig. 4B and comprises an ATM interface 
card 210 and a main processor board 250, typically both 
being moiinted together. The ATM interface card cott^rises 
an ATM line interface 220 that interfaces the link 
between the ATM switch and an ATM cell processor 230. 
20 The processor 230 connects to both an ATM transmitter 
state machine 240 and an ATM receiver state machine 245 
for arranging the incoming data and outgoing data on the 
transmission link. The two state machines connect to the 
main board which has an ethemet interface 251 and a 
25 console dial-in port interface 252, which together 
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provide control information from a network control center 
or remote operator console to a microprocessor and 
applications software module 253, which represents all of 
the intelligence for the interface. Appropriate software 
5 modules are stored in RAM 254 for access by the 
microprocessor on demand. The microprocessor will 
control a signal interface 255 that receives the ATM 
communication information output from the ATM Tx state 
machine 240 and provide it to the transmission subsystem 

10 260 on the main board, as represented by a traffic RAM 
261 that stores incoming and outgoing transmission data, 
a transmission timing module 262 that controls the timing 
of the transmission, and the coding module 267 and burst 
modulator 264, that prepares the communication for 

15 transmission in burst form on a carrier. The 
transmission subsystem 260 also includes a burst 
demodulator 265 that receives the input burst received on 
a downlink carrier and a decoder module 266 that provides 
the decoded information to a receiver timing module 267 

20 for presentation to the traffic RAM via bus 268. The 
data is transferred via interface 255, under control of 
microprocessor and software application 253 for input 
into the ATM receiver state machine 245. The ATM cell 
processor 230 will process the incoming data and provide 

25 it to an ATM line interface 220 for access by the ATM 
system and switch (not shown) . 
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In the variety of networks that can incorporate the 
present invention, information is separated based on time 
division and is transmitted using a framing structure. 
Such a framing structure is commonly used in TDMA 
satellite networks, but may also appear in other networks 
as well. For example, terrestrial networks also have 
framing structures (e.g. for Tl or El framing etc.). In 
this regard, a ""frame" is a fixed period of time, and is 
delimited by some mechanism for identifying the start and 
end of that time period. In satellite networks, frames 
are usually of the order of milliseconds- A frame 
contains "^bursts" , each of which is a contiguous stream 
of information from a common source, the plurality of 
bursts in a frame typically being from different 
information sources. Where a terminal is to transmit a 
plurality of bursts in a frame, the beginning of 
transmission of the frame is defined as the *start of a 
transmit frame" , henceforth called the ""SOTF instant" . 
Similarly, where a terminal is to receive a frame, the 
beginning of the frame when received is defined as the 
"start of receive frame" and the beginning of reception 
of the frame is henceforth called the "^SORF instant" . 

Bursts contain channels, and information in the form 
of "data" is transmitted on the channels, often in cell 
or packet form. Conventionally, for chemnels carrying 
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cell- or packet -based data, there are check bits on the 
channel that allow detection of errors in reception of 
data on that channel . It is assumed that when such errors 
cannot be corrected all data received in the channel is 
5 discarded. Each burst is defined by a fixed duration of 
time or '^offset" (henceforth referred to as ^burst 
offset") relative to SOTF or SORF, depending on whether 
the burst is being transmitted or received by that 
terminal, respectively. Bursts are transmitted repeatedly 
10 every frame. Each burst is assigned an identifier (id) 
called the "^Burstld", which is unique in the network. 

Typically, a network that can utilize the present 
invention contains several carriers. These carriers are 
defined by different frequencies. A burst will be 

15 allocated for transmission on a carrier. Consequently, 
bursts on the same carrier cannot overlap in time. 
However, bursts on different carriers may overlap in 
time. Each carrier is identified by a '^Carrierld" which 
is unique in the network. Carriers are subdivided into 

20 "slots" , and no two bursts Ccin begin in the same slot in 
one carrier, i.e., burst offsets should fall in different 
slots. 

Turning again to Figure 4A, the satellite/wireless 
link 130 is illustrated with the notation Bi (i= 1, 2, 3, 
25 4«) being used to denote bursts and Ci (i= 1, 2...) to 



wo 99/04521 PCr/US98/14194 

24 

denote carriers. As illustrated, each of a plurality of 
carriers may simultaneously transmit a stream of bursts 
that are organized on a time division basis. Figure 5 
shows the structure of a TDMA frame for such time 
5 division transmission, wherein two successive frames are 
shown on a single carrier, each frame having three bursts 
Bl, B2 and B3 . From this illustration, it can be 
understood that the bursts Bl in each of the frames 
relate to the same data source and are merely separated 
10 in time; the same being true for bursts B2 and B3 . 

The equipment in terminals T(i) that are used for 
time division transmission and reception of information 
in bursts, particularly in TDMA communications as in the 
preferred embodiment, is collectively referenced herein 

15 as "^^modems" . Bursts that are formed in the terminals by 
the time division equipment are allocated among modems 
for transmission, and are allocated at the receive end on 
the basis of carrier frequency. It is assumed that the 
terminal that transmits or receives a burst knows the 

20 offset of the burst relative to the start of the 
respective frame and the Carrier Id of the Carrier on 
which it is transmitted. It is also assumed that if a 
terminal (e.g., Tl) at a site (e.g., SI) uses a burst on 
another terminal (e.g., T3) to transmit its data, it is 

25 aware of the offset and the Carrier Id of the burst. 
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In accordance with a basic principle of the present 
invention, bursts and packets are addressed to and from 
specific terminals. A terminal is identified by a lanique 
id called the **Terminal Id" which is tinique in the 
5 network. The format of the Terminal Id is shown in Figure 
6. Referring to the content of the figure, a twenty- four 
bit header is shown, comprising three fields. The first 
field (8 bits) identifies the ''control group" to which 
the terminal belongs. The second field (11 bits) 

10 identifies the "site" within the control group to which 
the terminal belongs. The third field (5 bits) identifies 
the particular "unit" within the site. An all I's site 
number and unit number is used as a broadcast address for 
all terminals in a control group. The lengths of the 

15 fields shown in Fig. 6 are as used in a preferred 
embodiment, but the applicable algorithms could easily be 
made to work with different lengths. 

The packet formats shown are for the preferred 
embodiment, which is designed for transmission at a rate 
20 of 8 Mbits/ sec of data transfer between adjacent nodes. 
However, clearly the concepts disclosed herein can easily 
be made to work with similar packet formats where the 
field lengths or data rates are different. 

Turning next to the segmentation and reassembly 
25 features of the invention, these are performed on a hop- 
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by-hop basis, i.e., at each transmission from one 
terminal to another, even though multiple hops may 
ultimately be involved. Each terminal has a packet 
segmentation sequence number. This is an unsigned number 
5 (i.e. after 65535 it wraps around to 0) . At startup it 
is initialized to 0 and is then incremented for each 
packet as described below. 

In operation, for example, it may be assumed that 
the transmission system has a protocol that permits 

10 transmission of information by variable length packets 
and that one such packet is originating at terminal Tl of 
Fig. 4A- Assuming a packet to be transmitted has a length 
of more than 51 byte segments, the length of the packet 
is defined (2 bytes) and that value is prepended to the 

15 packet. The packet itself is segmented into 51 byte data 
segments, each being combined with a SAR2 header to foinn 
a 54 byte SAR segment, as shown in Figure 7A. The header 
that is prepended to each segment comprises a 3 byte SAR2 
(segmentation and reassembly) header, as shown in Figure 

20 7B. The SAR2 header includes 2 bytes that define the 
packet sequence number (PktSeqNo) and one byte that 
contains bits defining validity (V) , SARid, first (P) , 
last (L) , optional (O) and Port -id. 

The SAR header should be filled as follows. The "^SAR 
25 Id" should be set to 1, and is incremented for each 
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subsequent segment in a given packet. The "first" (F) and 
the ''last" (L)bit indicators should be set to 1 in the 
first and the last segments of the packet. The '"PktSeqNo" 
field in all segments should be set to the terminal 
5 packet segmentation sequence number, as it identifies the 
position of the packet among other packets at a given 
terminal. The "Port-id" is used to identify the 
application at the remote terminal to which the packet 
should be delivered. The Valid (V) bit is set at the time 

10 of transmission of the segment in a burst. If it is 1, it 
indicates that a segment carrying data is present, 
otherwise it indicates the presence of an empty SAR 2 
segment. Enpty segments are discarded upon reception and 
are not delivered to the resequencer. The optional bit 

15 (O) is reserved. 

Once the bits in the header for all segments of a 
packet are filled, the terminal packet segmentation 
sequence number PktSeqNo is incremented by one and the 
process is repeated. Where the last segment does not 
20 contain a sufficient quantity of data, a fill pattern is 
used, comprising a predetermined pattern, i.e., all I's. 

For ATM cells, which are fixed in size (53 bytes) , 
there is no segmentation. The 1 byte SARI header is 
prepended to the cell, as seen in Figure 8A, resulting in 
25 a SAR of 54 bytes. The network is optimized for ATM cells 
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and the ATM cell size of 53 bytes determines the segment 
data size of 51 bytes for SAR2 in order to have a uniform 
SAR segment size of 54 bytes in all cases. 

Fig. 8B illustrates the content of a burst within a 
5 frame on a carrier that is used for the transmission of 
user packets or cells with a SAR segment arrangement. 
Seen within a burst is a preamble as a header followed by 
SAR segments and ending with coding bits for error 
control within each burst. Each SAR segment comprises a 
10 SAR header and followed optionally by a definition of the 
length of the packet and the user packet or cell. 

The ability to provide variable bandwidth on demand 
at a given site 300 is provided by an arrangement as seen 
in Fig 8C, for example. Two terminals 310 and 350, each 

15 having similar structures, are interconnected to provide 
an ability to handle overflow of required capability. 
ATM signals input from switches or terrestrial links via 
lines 305 and 306, respectively, are input to ATM/Frame 
relay physical and link layer processing in units 311, 

20 351. In the output direction, the ATM signals are 
segmented at segmentation unit 312, 352 and presented to 
per-VC queues 313, 353 for organization, as disclosed 
herein, and subsequent burst creation in units 315, 355, 
followed by transmission burst generation, coding and 

25 modulation in iinits 316, 356 for output at terminals 341, 
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343 . Where excess capacity is required and is available 
in a connected terminal, the schedulers 314, 354 are 
arranged to provide a portion of their output to the 
transmission burst creation unit 355, 315, respectively. 

Similarly, on the receive side, the signals input at 
links 342, 344 are fed to receive burst reception, 
decoding and demodulation units 317,. 357 and bursts are 
extracted in units 318, 358 for arrangement in queues 
313, 353 for reassembly. The queue manager 319, 359 
provide the received information to the appropriate 
queues, whether in the same terminal or another terminal 
via interconnection links 330, 335. The queues 313, 353 
that receive the packets permit them to be reorganized 
and ultimately reassembled in units in reassembly devices 
321 and 360. The information reassembled from the queues 
is reorganized into ATM or frame relay formats by 
appropriate physical and link layer processing in units 
311 and 351. 

In order to achieve efficiency for data 
transmission, each terminal will maintain a list of 
bursts on which that particular terminal is allowed to 
transmit. This list is kept sorted (e.g., by Carrierld, 
burst position in frame, channel in burst) . Channels are 
picked in their order in the list for transmission of 
segments. The SAR segment is then sent to the appropriate 
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modem for transmission. The destination and source 
terminal ids, burst id and channel ids are also sent with 
each segment. The modem appends received segments to the 
specified burst for transmission. Thus the order of 
5 transmission of segments in a burst is the same as the 
order in which the terminal sent those segments to the 
modem. The transmission format for segments in bursts is 
shown in Figures 9A-9C. 

In Case 1 seen in Pig. 9A, the source and 
10 destination terminal ids of the segment are the same as 
the source and destination terminal ids for the burst. 
Hence, they do not need to be transmitted. 

In Case 2 as seen in Fig. 9B, the burst originates 
from some modem at the same source site as the segment 

15 and is destined to some modem at the same destination 
site as the segment. Thus, the control group and site 
fields of the segment source terminal id are identical to 
the control group and site fields of the burst source 
terminal id. Therefore, only the unit id needs to be 

20 sent. Similarly, for the destination only the unit id 
field of the destination terminal id needs to be sent. 

In Case 3, as seen in Fig. 9C, the source control 
group of the segment terminal id is identical to the 
source control group of the burst. Therefore, only the 
25 site and unit ids need to be sent. Similarly, for the 
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destination only the site and xinit id fields of the 
destination terminal id need to be sent. 

Also, periodically the algorithm may be designed to 
scan queued up segments (every 50 millisec) and discard 
5 those segments whose id's indicate that they have not 
been sent (due to lack of bandwidth) for too long of a 
period (1.5 sees) . This technique prevents sequence 
number wrap around. If this were not done, segments of 
two different packets from the same source terminal, with 
10 the same packet sequence number, could be present 
simultaneously at the same reassembler. This would result 
in a packet being reassembled incorrectly, 

In operation, as seen in Pig. IIA, an incoming cell 
or packet is examined in step llA-1 and in step llA-2, a 

15 determination is made as to whether the size is equal to 
the minimum size, e.g., an ATM cell size. If the 
incoming packet or cell is only the minimum size, a 
decision is made at step llA-3 that segmentation is not 
needed and in step llA-4,the SARI header is generated . 

20 The SARI header comprises only one byte, as shown in Fig. 
8. In step llA-7, the header is applied to the data in 
the packet or cell and id forwarded to the modem at a 
selected terminal at a site for addressing to a 
destination terminal and transmission to that terminal in 

25 a predetermined burst. Where it is determined in step 
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11A2 that the incoming cell or packet is greater than a 
minimum size, there is a need to have the cell or packet 
segmented for transmission. Thus, in step llA-5, the 
cell or packet is divided into predetermined size 
5 segments, followed by the generation of a SAR2 header in 
step llA-6. As noted above, and as seen in Fig. 7A and 
7B, the SAR2 header is a three byte header that changes 
for each segment and contains information sufficient to 
identify each segment in each packet by its terminal. 
10 Finally, the SAR2 headers are combined with appropriate 
segments and are forwarded to a modem for transmission in 
bursts . 

The transmission of the segments with SARI or SAR2 
headers is iindertaken on the basis of the process 

15 illustrated in Fig. IIB, where the nature of point-to- 
point transmissions is determined so that a minimum 
amount of overhead is used while ensuring accurate 
delivery and reassembly of the transmitted packets. 
Initially at a terminal, in step llB-1, a check is made 

20 of a list of authorized bursts for a given terminal, the 
list being sorted by carrier id, burst position in frame, 
and channel in burst. The segment and appropriate header 
is sent to a proper modem in accordance with that list in 
step llB-2. In step llB-3, source id and destination ids 

25 are identified for both the segment and the burst, in 
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order to determine what additional information must be 
sent. As this is a bandwidth on demand architecture, 
where the capacity of other terminals must be used to 
accommodate a high bandwidth requirement for a given 
transmission, a decision must be made as to how much 
additional information must be sent in order to properly 
reassemble the transmitted information at the receiving 
end. The goal is to transmit the minimum amount of 
needed overhead information in order to make most 
efficient use of the available bandwidth for information 
transmission. In order to meet this goal, in step llB-4, 
an initial determination is made as to whether the burst 
and segment have the same source and destination id, 
i.e., are from the same terminals. If so, no information 
identifying the segment origin is needed and the burst is 
simply generated in step llB-5 for transmission within 
step llB-11. For such case, the transmission PDU format 
illustrated in Fig. 9A is used, where there are point-to- 
point bursts between sites which have only one terminal 
each. However, if it is determined that there is a 
difference, a check is made in step llB-6 as to whether 
the segment and burst are from the same site, even though 
the units may differ. If that is the case, then the 
burst is generated with information identifying the unit 
in step llB-7 and the combined burst and xinit id is 
transmitted in step llB-11. This case applies to a 
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situation where there still are point-to-point bursts and 
one byte of header information is needed to identify the 
source and destination terminals, respectively. Where 
there is even a difference in site identified in step 
5 llB-6, a determination is made in step llB-8 as to 
whether at least there is a common control group, as case 
where there are non-point-to-point bursts. If so, in 
step llB-9 a burst is generated and is combined with a 
unit id and site id for transmission in step llB-11. 

10 Finally, if there is no commonality of at least control 
group in step llB-8, in step IIBIO the burst is combined 
with the unit id, site id and control group id as seen in 
Fig. 6 and the combination is then transmitted in step 
llB-11. The segments are transmitted in bursts in the 

15 order of their CarrierlD and Bust Position in Frame. 

As to the reception process, there is a basic 
requirement that bursts with any of a variety of required 
identification infoinnation must be extracted from the 
TDMA system at an addressed destination terminal for 

20 reception by a modem. With reference again to the 
traditional model for inverse multiplexing as seen in 
Fig. 3, when the principles of the present invention are 
applied thereto, the receiving modem processes segments 
in their order of reception in the burst. These segments 

25 are delivered to the inverse multiplexer 30 located at 
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the terminal identified by the destination TerminallD of 
the segment. Broadcast segments also are sent to the 
inverse multiplexer 30 at this terminal. Since the 
segments were transmitted in bursts in the order of their 
5 CarrierlD and Burst Position in Frame, sorting segments 
by their CarrierlD and Burst Position in Frame restores 
the original order of the segments. 

Sorting is done within a received frame in two 
passes, one for resequencing emd one for reassembly. 

10 There are two tables used for these two steps of the 
sort . This is done in order to reduce the memory 
requirement for the tables. Alternatively, sorting could 
have been performed in a single pass but it would require 
a table with 65536 buckets. Also, a large table implies 

15 more time is required to scan empty buckets of the table. 
Each bucket of a table contains a queue of segments. At 
the beginning of each receive frame both tables are 
empty. The 16 bit key for the sort is composed as seen in 
Fig. 10, and comprises a CarrierlD (8 bits) and a Burst 

20 Slot ID {8 bits) . 

The use of 8 bits for CarrierlD is based on an 
assumption that there are a maximum of 256 carriers in 
the network. The use of 8 bits for Burst Slot ID is based 
on the assumption that the highest carrier data rate is 2 
25 Mbits/ sec and the smallest burst carries at least 8 
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kbps of data (2000000/8000 = 250) . Let the number of bits 
in the key be bk. If this is odd, set bk to the next 
higher even number. The sizes of the two tables are then 
2*^^/2^ each. 

5 With reference to Fig, 12A, a flow chart for the 

resequencing process is illustrated. Initially, one of 
the plurality of modems is selected in step 12A-1 and a 
segment from that modem is received in step 12A-2. On 
receiving a segment from a modem, its Burst Slot is 
10 computed in step 12A-3, as shown below, and the key is 
composed in step 12-A4- 

Burst Slot = Burst Position * MaxSlotsPerCarrier / 
Frame Size 

where Burst Position and Frame Size are in the same 
15 xinits. 

Then, in step 12A-5, the algorithm computes the 
Table_0 bucket as (key mod Table_0_Size) . And in step 
12A-6, the segment is appended to the queue for that 
bucket . 

20 A check is made as to whether the modem has 

delivered all segments in the frame at step 12A-7 and the 
process returns to step 12A-2 until the answer is yes. 
When a modem has delivered all segments received in a 
receive frame, it sends the END_OF_FRAME marker to all 

25 resequencers at the site at step 12A-8. Thereafter, a 
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check is made at step 12 A- 9 as to whether an END_OF_FRAME 
marker has been received from all modems. If not, the 
process returns to start and a modem that has not yet 
been processed is selected xintil all modems have issued 
5 an END_OF_FRAME marker. Needless to say, the process of 
assembling the segments for modems can take place in 
parallel, rather than in series, as illustrated solely 
for convenience and sinplicity. 

The second pass of the sort at a resequencer begins 
10 when the END_OF_FRAME markers have been received from all 
modems at this site. This reassembly process is 
illustrated in Fig. 12B and is described subsecjuently . 
Initially, in step 12B-1 a bucket is selected in Table 0 
and a determination is made as to whether the queue in 
15 the bucket is empty, as seen in step 12B-2. Where not 
enpty, the segment at the head of the queue is output, as 
seen in step 12B-3 and as described below: 

for each bucket (0 . . Tcible_0_Size - 1) in Table_0 

20 do { 

while the queue for the bucket is not empty { 

remove the segment at the head of the 

queue 
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In step 12B-4, the Table_l bucket is computed 

as (key / Table_0_Size) and in step 12B-5 the 

segment is '^appended" to the queue for that 
bucket } 

5 } 



for each bucket (0 , . Table_l_Size - 1) in Table_l 

do { 

Finally, as seen in step 12B-6 and 12B-7, where the 
10 cjueue for the bucket is not empty, the segment at the 
head of the queue is removed and delivered to the 
reassembler . 

Note that in the above process, segments are first 
resequenced, then reassembled. This simplifies the 

15 reassembly algorithm. There is one reassembly buffer per 
source terminal per packet. These are stored in a data 
structure keyed by Source Terminal and packet sequence 
number. In accordance with the flowchart illustrated in 
Fig. 12C, on receiving a segment with SARId equal to 1 

20 (variable length packet) from the resequencer, the 
following steps are followed after receiving such 
segment . 

If both the F and L bits are set, as determined in 
step 12C-1, the packet consisted of only one segment- The 
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packet is then reconstructed and delivered to the 
application in step 12C-2. Otherwise, if the F bit is 
set, as determined in step 12C-3, a new reassembly buffer 
is created. At that time, the SAR header is removed and 
5 the segment data is appended to the reassembly buffer in 
step 12C-5. A time stamp also is applied to the buffer 
with the current time. If the F bit is not set, as 
determined in step 12C-3, a check is made as to whether 
the L bit is set in step 12C-6. If the L bit is not set, 

10 in step 12C-8, a search is made for the reassembly buffer 
and if no reassembly buffer is found, the segment is 
discarded. If a reassembly buffer is found, the segment 
data is appended to the buffer. Finally, if only the L 
bit is set, in step 12C-7, the length is restored and a 

15 check is made as to whether all segments have been 
received (based on the length) . If so, deliver the 
packet to the application, else discard the packet. At the 
end, the reassembly buffer is destroyed. 

Periodically the reassembly buffers are scanned and 
20 those whose time stamps are too old. (greater than 1 sec) 
are discarded. This prevents sequence number wrap around. 

On receiving a segment with SARId = 0 (an ATM 
segment), there is no reassembly. The 1 byte SAR header 
is popped and the segment is delivered to the 
25 application. 
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Fig. 13A is a high level description of a frame 
relay system that performs frame relay processing to 
efficiently carry frame relay packets over 
wireless/satellite links. This system can perform the 
following : 

• Frame Relay processing at the Physical Layer eind the 
Data Link Layer 

• Formatting of Data (variable length packets, 
segmentation and reassembly, resequencing) 

• Dynamic Forward Error Coding 

• Interleaving of frames (to spread the effect of burst 
errors) 

• Per-VC data compression 

• Prioritization and Scheduling 

• Header Compression 

In the high level description of the various 
functions performed in the system seen in Fig. 13A, to 
the left of the diagram is the private/public frame relay 
network and to the right is the satellite/wireless link. 

The illustrated system uses a robust, flexible frame 
format between the 2 communicating terminals which allows 
the transport of several variable sized Spackets 
(segmented packets) in a frame and also to carry a single 
Spacket over several frames, whichever the case might be. 
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Also, the frame format allows fast synchronization and 
the exchange of coding information. Each frame contains 
Reed- Solomon check bytes that are used for error 
correction and to enhance the quality of the 
5 satellite/wireless link. The number of RS check bytes in 
a frame can be changed on the fly, without any loss of 
data, to compensate for varying link conditions. The 
decision to change the RS check bytes in a frame is based 
on the constant monitoring of the link quality. Several 

10 frames are also interleaved before transmission over the 
satellite/wireless link, to help spread the effect of 
burst errors over several frames, all of which can then 
be corrected by the PEC in the frames. Also, Virtual 
Channels (VCs) can be configured to be enabled for data 

15 compression, which means that the Spackets belonging to 
the VC are to be passed through a data 
compressor/decompressor combination to save bandwidth. 
VCs can also be configured to be either high or low 
priority VCs and the scheduler then, uses this 

20 information to fairly transmit the various Spackets over 
the satellite/wireless link. 

In operation, a private or public frame relay 
network provides the frame relay packets to the frame 
relay physical and data link layer processing block 2000, 
25 where they are received and processed as specified in ITU 
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recommendation Q.922 (Link Access Procedures for Frame 
Relay) . The physical layer processing is similar to the 
processing of any HDLC data stream. This is the 
processing performed in most Frame Relay Access Devices 
5 (FRADs) . 

A frame relay packet received from the terrestrial 
network consists of payload data and a CRC field, and 
flags at the beginning and the end of the frame. The 
frame relay processing removes the flags and the CRC 
10 fields and transports only the payload section of the 
frame relay packet over the satellite link. The CRC and 
the flag information is regenerated at the receiving 
terminal and added to the packet before it is transmitted 
to the receive side terrestrial network. 

15 In prioritizer/VC ident if ier /Segment at ion processor 

2100, the variable length frame relay packets are 
segmented into several smaller packets called Spackets. 
The Spackets allow efficient scheduling of packets 
belonging to multiple priorities and loss less data 

20 compression. Figure 13B illustrates the various fields in 
a Spacket, whose content provides for efficient 
processing of the Spackets, as subsequently described. 

In order to avoid an intolerable delay of high 
priority packets (e.g., audio and video) due to 
25 processing and transmission of low priority packets. 
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Spackets belonging to a high priority packet could be 
transferred after a single Spacket from a low priority- 
packet has been transferred, thus minimizing the delay- 
variance that the high priority packet experiences. This 
5 technique minimizes the delay variance significantly and 
the satellite/wireless network performance is better than 
terrestrial networks, as far as delay variance is 
concerned. Thus, when each frame relay packet is 
segmented into one or more Spackets, all but the last 

10 Spacket are n bytes long. The last Spacket could also be 
n bytes long if the frame relay packet, to begin with, 
was of a length that was an integral multiple of n. A 
Spacket is then propounded with a header as shown in 
Figure 13B that contains a Virtual Channel (VC) 

15 Identifier for the channel to which the packet belongs. 
Also, the header is supplied with the packet and the 
sequence numbers . The packet number increments for each 
new frame relay packet. The sequence number increments 
for each Spacket within the frame relay packet. 

20 Information about the priority of the packets and whether 
or not the packets are compressed is maintained locally. 
All this information is used to perform 
segmentation/reassembly, data compression/decompression, 
prioritization and scheduling. The ^last field" indicates 

25 whether or not the Spacket is the last Spacket for the 
frame relay packet. If it is, then at the receiving 
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terminal, the frame relay packet can be reassembled and 
transmitted over the terrestrial link. 

The sizes of the various fields can be left to the 
discretion of the system designer. The VC Id field would 
5 either be the size of the entire VC field in the frame 
relay packet or could be the size specified in the header 
compression parameters. The size of the Packet number and 
Sequence number are also left to the system designer. The 
"last field" is a single bit. The size of the payload is 

10 determined by a trade-off between the overheads and the 
performance of the system. If the payload size is very 
low, the overheads will be very high, but the delay 
variance performance of the system will be very good. If 
the payload size is set to a large value, then the delay 

15 variance performance will be poorer but the overheads 
will be lower. Hence, the sizes would depend on the 
overheads the designer is prepared to allow, and the 
performance specifications of the system. 

Next, queues of Spackets belonging to different VCs 
20 are stored for use by the scheduler in Per-VC or priority 
queues 2201 and 2202. In the case of a priority queue, 
high priority queues 2201 and low priority queues 2201 
are maintained and the cells in each priority queue are 
transmitted on a FIFO basis. A more preferable mode of 
25 queuing is to have a queue for each VC, which is 
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designated to have a high or low priority, and then store 
the cells belonging to each VC in its corresponding 
queue. Cells in these per-VC queues are also transmitted 
on a FIFO basis to preserve sequence integrity. 

5 A scheduler 2300 sends Spackets belonging to various 

priorities or VCs over the satellite link. The scheduler 
is designed to be fair to VCs within a priority and 
between priorities as well. If the Spacket is to be 
compressed then it is sent to the Data Compressor 2400. 

10 The scheduler 2300 uses all the priority information for 
the various VCs and tries to be fair in the scheduling of 
the Spackets. A simple scheduling algorithm is to process 
all the high priority per-VC queues on a round-robin 
basis and then to process all the low priority per-VC 

15 queues on a round-robin basis. Another option for the 
scheduler would be to transmit at least one low priority 
cell every ^n" high priority cells. This could assure 
some degree of fairness between priorities. A further 
option would be, within a priority, to use a weighted 

20 round-robin scheduling algorithm to transmit cells from 
per-VC queues, the weights reflecting the bandwidths that 
the VCs have subscribed for. This scheduling algorithm 
will attempt to schedule different VCs fairly. 

Spackets which belong to a VC which has been 
25 specified to be compressed are compressed in data 
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compressor 2400. To achieve loss-less data compression, 
the cotnpression and deconipression histories are reset 
every n Spackets, where n is a configurable parameter. 
With the FEC, the link is maintained at a very low BER. 
5 If a Spacket does get corrupted, then the resetting of 
the histories, will ensure that not more than n Spackets 
are affected. 

Finally, the compressed or uncompressed Spackets are 
provided to a satellite/wireless frame processor 2501, 

10 which incorporates the Spackets into a frame for 
transmission over the satellite/wireless link. This frame 
structure has been designed to facilitate fast frame 
synchronization, accommodation of several varicible-size 
packets, fast recovery from lost frames, very low 

15 bandwidth overhead, as well as dynamic Reed- Solomon coding 
change without introducing data loss during the coding 
rate change transition. Figure 13C shows the frame format. 

The fundamental unit of transmission over the 
satellite/wireless link is a fixed size frame, which is n 
20 octets long. If an interleaving depth of I is used, then I 
such frames are used to compose an ^interleaver frame" . 
The interleaver rearranges the order of the bytes in the 
interleaver frame and transmits each byte sequentially 
over the satellite/wireless link. It should be noted that 
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there are no special synchronization bits in this frame 
structure . 

Each frame is n bytes long and consists of: 

- a 2 -octet header 

- followed by the frame payload, and 

- terminated by 2t octets (t > 0) of Reed-Solomon 
coding check bytes in the end. 





Does not include the first Spacket, if any 
Includes the last Spacket, if any 


SizeO 


Size of first partial Spacket in frame 
divided by 4 . 


FrameNum 


The frame nimiber 

Each frame is sequentially ntmibered 0, 1, 


Coding 


If FrameNum > 3, the coding field 
represents the number of Reed-Solomon 
octets / 2 that will be used starting 
with the next frame numbered 0, Note that 
0 is an invalid value for the coding 
field. 
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If FrameNum == 0, EEi coding field 
represents the suggested value of the 
number of Reed- Solomon octets / 2 that 
the other side should use for its own 
transmission. If the coding field value 
is OxF, the value implies that the 
transmitting terminal is not yet 
synchronized to its receiving bit stream. 
Note that 0 is an invalid value for the 
coding field. 



If FrameNum == T, EHe least significant 
bit of the coding field is 1 if Spacket 
header compression is activated at the 
transmitting terminal, 0 otherwise. Other 
bits of the field are reserved for future 
use. 



If FrameNum is 2 or 3, the coding field 
shall be set to O's- 



Table 1 

The payload contains a combination of several 
variable-size packets (the packets may contain compressed 
or uncompressed Spackets) . 

The rules for filling a frame payload with Spackets 
5 are as follows: 

1. If the previously transmitted frame contained a 
partial Spacket at the end of the payload, the 
frame payload currently being transmitted begins 
with the next portion of that Spacket . This 
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portion shall consume min(4 * sizeO, 
payload_size) octets of the payload, where sizeO 
0. The actual size of this partial Spacket may 
be up to three octets less than 4 * sizeO, in 
which case the extra octets shall be filled with 
zeroes . 

2. After the initial partial Spacket segment, the 
payload contains count 0 Spacket s where count 0 

0. If the last Spacket cannot be entirely 
contained in the payload, then only its initial 
portion is included in the payload. Each Spacket 
is preceded by a 1-octet-length (in octets) 
field followed by the Spacket contents. The 
length field contains the size of the Spacket in 
bytes. 

3. If there are any octets left over in the 
payload, then the first such unused octet shall 
contain a zero. The rest of the octets, if any, 
shall be filled sequentially with the numbers i, 
i+1/ i+2, where i is the octet number of 
the first such octet in the payload (octets in 
the payload are implicitly numbered 0, 1, ...). 

From these rules, one can see that a frame payload 
may contain several Spackets and that the Spackets can be 
transmitted over more than one frame. A frame with no 
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Spackets contains the sequence 0, 1, 2, ... in the 
payload. A Spacket may be split across more than two 
frames if required. 

This frame structure design allows the possibility of 
5 dynamically changing the Reed- Solomon code size by 
correspondingly changing the payload size but keeping the 
frame size constant. If the receiver "loses" a frame, for 
example, due to excessive bit errors in the frame, the 
sizeO field allows rapid determination of the Spacket 
10 boundary on the very next frame. The frame header, shown 
in Figure IIC, has four fields which are described in 
Table 1, wherein the Reed-Solomon check-bytes are the 
check-bytes generated by a standard Reed-Solomon algorithm 
with frame size =N bytes and number of check bytes = 2t. 

15 During the time that the system has not achieved 

receive synchronization, it sets the Reed-Solomon code 
value of its receiver and its transmitter to the maximum 
value. After the system achieves receive synchronization 
and it detects that the remote terminal has also achieved 

20 receive synchronization (i.e., the coding field in the 
received frame header of frame number 0 contains a valid 
code value) , it activates an adaptive coding algorithm. 

Transmissions from the satellite/wireless network are 
received and processed by a Satellite/Wireless frame 
25 processor 2502, which performs the inverse operation of 
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that performed by the frame processor 2501, strips the 
Spackets from the frame format and produces the compressed 
and un-conpressed Spackets. 

Next, compressed Spackets are sent to Data 
Decompression module 2600, which decompresses the 
Spackets belonging to a VC which has been configured to 
be compressed. Compression and decompression histories 
are maintained in the Data compressor 2400 and the 
decompressor 2600, respectively. These histories are 
reset once every n Spackets, where n is a configurable 
parameter. This is done to minimize the effect that a 
lost or erroneous Spacket has on the following Spackets. 

A reassembly and resequencing processor 2700 keeps 
track of Spackets belonging to all the VCs. The 
reassembly algorithm works on a per-VC basis. The 
Spackets for each VC are resequenced based on the 
sequence and packet numbers. The following rules are used 
to reassemble frame relay packets: 

• If a Spacket with a sequence number of zero is 
received, discard any previous incompletely assembled 
frame relay packet and start reassembling this new 
packet . 

• If a Spacket with the same packet number and VC Id, 
with a sequence number one more than the previous 
Spacket is received, then append this Spacket to the 
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partially reassembled frame relay packet. If the '*last 
field" indicates that the Spacket is the last Spacket 
of a frame relay packet, the frame relay packet has 
been completely assembled. 

5 • If a Spacket with sequence number which is out of 
sequence, and non-zero, is received, discard this new 
Spacket and any partially reassembled frame relay 
packet . 

• If the packet number of the Spacket received is not the 
10 same as that of the previous Spacket and the sequence 

number of the received Spacket is not zero, discard 
this new Spacket and any partially reassembled frame 
relay packet. 

Optionally, a length field could be added to the 
15 frame relay packet at the transmitting terminal before it 
is segmented and transmitted over the satellite/wireless 
link. This length field could be used at the receiving 
terminal to check if the frame relay packet has been 
reassembled properly. If it hasn't then the frame relay 
20 packet is added to the transmit queue 

A transmit queue 2800 contains frame relay packets 
received from the remote terminal which will be 
transmitted over the terrestrial link. These packets are 
processed by the frame relay physical and data link layer 
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processing module and transmitted over the terrestrial 
link. 

Finally, the frame relay physical and data link 
layer processing module 2000 will reassemble the Spackets 
5 in to the appropriate frame relay configuration for 
transmission over the private or public network. 

In order to save bandwidth, a header con5)ression 
technique, similar to that used for ATM transmissions as 
described previously, may be used to compress the VC Id 

10 of a frame relay packet into a smaller value. This 
technique utilizes the fact that the number of VCs 
carried over the satellite/wireless link is not very 
large and can be compressed to a much smaller VC Id 
space. If header compression has been enabled in the 

15 system, then the VCs are mapped into a new value as 
specified by the size of the compressed VC field. This 
header compression information is periodically exchanged 
between the communicating terminals. Also, every time a 
new mapping is created, this information is 

20 asynchronously exchanged between the terminals before the 
actual transfer of the mapped packet begins. 

The present invention would be applicable to the 
frame relay inplementation described above, where 
bandwidth on demand is required and a plurality of 
25 terminals are co-located at a site and the capacity of co- 
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located terminals is accessed for transmission of 
information requiring capacity in excess of the normal 
capacity at a given terminal or modem, as seen in Fig. 4. 
As described generally with regard to the preferred 
embodiment, the algorithms set forth in Figs. 11 and 12, 
using the frame and header configurations seen in Figs. 6- 
10, can be used to transmit frame relay signals as 
illustrated in Figs. 13B and 13C. The satellite/wireless 
frame processors 2501 and 2502 would be adapted to provide 
the functions seen in the algorithms of Figs. 11 and 12, 
as would be apparent to one of ordinary skill in the art. 

While the present invention has been described in 
connection with certain preferred embodiments, it is not 
limited thereto and the scope of protection to which the 
invention is entitled is defined by the appended claims 
invention in accordance with applicable principles of law. 
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What Is claimed ia; 

1. A coTTtrrtunication system for efficiently 
transmitting information signals that were formatted in 
variable sized packets of more than a minimum size by 
using time division transmission of packet segments and 
5 allocating available bandwidth on demand, said system 
comprising: 

a satellite/wireless network; 

at least two sites, each comprising a plurality of 
terminals operative to transmit and receive signals via 
10 said satellite/wireless network and a local area network 
for interconnecting said terminals at a common site, each 
said terminals comprising: 

(a) a modem for transmitting signals from a terminal 
on predetermined channels having a predetermined 

15 bandwidth; 

(b) means for time dividing data signals input to 
said terminal from an external location and for assembling 
said time divided data signals as bursts within repeated 
frames, each frame having a unique frame header; 

20 (c) means for dividing information signals arranged 

in variable sized packets into a plurality of segments; 
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(d) mecuis for combining each segment in said 
plurality of segments with a lanique segment and reassembly 
header to form a SAR segment; 

(e) means for combining said SAR segments 
representing a single packet with a unique frame header to 
form a SAR frame; and 

(f) means for selectively appending a terminal ID 
header to each said SAR frame for transmission in a burst 
from a modem. 

2. The communication system as set forth in claim 1 
wherein each terminal further comprises: 

(g) means for detecting said SAR frame and for 
dividing said SAR frame into SAR segments; 

(h) means for rearranging the segments in said SAR 
segments on the basis of said SAR header; and 

(i) means for reassembling said packets on the basis 
of said rearranged segments. 

3. The communication system as set forth in claim 2 
further comprising means for receiving a SAR frame on the 
basis of said terminal ID information. 

4. The communication system as set forth in claim 2 
wherein said SAR frame comprises information defining the 
total length of said plxirality of SAR Segments 
representing a single packet. 
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5. The communication system as set forth in claim 2 
wherein said SAR segment comprises at least a signal 
identifying the packet sequence number for said segment. 

6. The communication system as set forth in claim 2 
wherein said SAR segment comprises at least a signal 
identifying a SAR id of such header. 

7. The communication system as set forth in claim 2 
wherein said SAR segment comprises at least a signal 
indicating whether a given segment is first or last among 
said plurality of segments defining a variable size 

5 packet . 

8. The communication system as set forth in claim 2 
wherein said SAR segment comprises at least a signal 
identifying at least one receiving modem for said packet. 

9. The communication system as set forth in claim 2 
wherein said terminal ID header comprises at least one of 
control group, site and unit information. 

10. The communication system as set forth in claim 2 
wherein said SAR header comprises one byte having 
identification information about a sending terminal and a 
receiving terminal. 

11. The communication system as set forth in claim. 
10 wherein said SAR segment is for point to point bursts 
between sites having only one terminal each. 
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12 . The communication system as set forth in claim 1 
further comprising means for detecting the needed 
bandwidth for transmitting information signals and for 
allocating segments of a single packet to respective ones 

5 of multiple modems. 

13. The communication system as set forth in claim 2 
further comprising a central network controller for 
assigning bandwidth among plural modems on a per packet 
basis . 

14. The communication system as set forth in claim 2 
further comprising a controller distributed among plural 
modems for assigning bandwidth among plural modes on a per 
packet basis. 

15. The commxinication system as set forth in claim 2 
further conprising means for filling a SAR segment with 
fill data when said packet does not have sufficient data 
to coirpletely fill a segment. 

16. The communication system as set forth in claim 2 
wherein said SAR segment has a uniform size data content. 

17. The communication system as set forth in claim 
16 wherein said size is identical to the size of an ATM 
cell- 
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18. The method of transmitting information arranged 
in packets from one location to a second location via a 
wireless/satellite network, comprising: 

(a) examining each packet to determine whether its 
size is equal to a minimum; 

(b) if a minimum size, generating a first SAR header 
and applying said header to said packet to form a SAR 
segment ; 

(c) if greater than a minimum size, dividing said 
packet into a pliirality of segments having a uniform size, 
generating a second SAR header that is unique for each 
segment and applying said header to a respective one of 
said segments to form SAR segments: 

(d) forwarding said SAR segments to one or more 
modems for transmission to at least one terminal at said 
second location. 

19. The method of transmitting information as set 
forth in claim 18 further comprising: 

(e) sorting said SAR segments by at least one of 
carrier id, burst position in frame and channel in burst; 

(f) sending said SAR segments to a predetermined 
modem; 

(g) determining whether the source and destination ID 
for segments and bursts are identical: and 
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(h) on the basis of the identity of the unit, site 
and control group, generating burst and identity 

information for transmission to said second site, 

20. A communication method as set forth in claim 19, 
wherein said packets comprise ATM cells. 

21. A communication method as set forth in claim 19, 
wherein said packets comprise frame relay packets. 

22. A communication method as set forth in claim 19, 
wherein said packets comprise at least one of ATM cells 
and frame relay packets. 

23 . A segmentation and reassembly cell comprising a 
segment of a packet suid a header comprising at least a 
packet sequence number for uniquely identifying a packet 
to which said segment relates, a SAR id for uniquely 
identifying the segment among all segments derived from 
the packet, and a destination id for \iniquely identifying 
the destination for the packet. 

24. A segmentation and reassembly cell as set forth 
in claim 23 further comprising a first and last segment 
indicator. 

25. A communication method for reassembling segments 
transmitted by a satellite/wireless network in a time 
divided manner by discrete bursts that identify the 
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terminals by at least one of \init, site and control group, 
5 comprising: 

selecting a modem and receiving a biirst at said 
selected modem on the basis of common addresses in said 
burst ; 

sorting segments within bxirst received by said modem 
xo to restore the original order of the segments prior to 
transmission; 

resequencing said sorted segments in a queue at a 
selected one of a plurality of locations on the basis of a 
burst slot and key; and 

15 combining said segments at each of said plxirality of 

locations to reassemble a packet. 

26. The method as set forth in claim 25 wherein said 
resequencing step comprises conputing a burst slot and 
composing a key for arranging said segments into a queue. 

27. The method as set forth in claim 25 wherein 
segments received in bursts are processed in the order 
received in the burst. 
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